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Abstract: The Murchison Widefield Array (MWA) is one of three Square Kilometre Array Precursor 
telescopes and is located at the Murchison Radio-astronomy Observatory in the Murchison Shire of 
the mid-west of Western Australia, a location chosen for its extremely low levels of radio frequency 
interference. The MWA operates at low radio frequencies, 80—300 MHz, with a processed bandwidth of 
30.72 MHz for both linear polarisations, and consists of 128 aperture arrays (known as tiles) distributed 
over a ~3 km diameter area. Novel hybrid hardware/software correlation and a real-time imaging and 
calibration systems comprise the MWA signal processing backend. In this paper the as-built MWA is 
described both at a system and sub-system level, the expected performance of the array is presented, 
and the science goals of the instrument are summarised. Keywords: instrumentation: interferometers 

— techniques: image processing — techniques: interferometric — radio coninuum: general — radio 
lines: general — cosmology: early universe 
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1 Introduction 

The Murchison Widefie ld Array (MW^ ^ is th e Square 
Kilometre Array (SKA: |Dewdney et al.[^2010| ) Precur- 
sor telescope at low radio frequencies. An SKA Pre- 
cursor is a recognised SKA technology demonstrator 
located at one of the two sites shortlisted for the SKA 
in 2006, the Murchison Radio-astronomy Observatory 
(MRO) in the Murchison region of Western Australia 
and the Karoo region of South Africa's Northern Cape. 
The MWA is one of two SKA Precursor telescopes 
sited at the MRO, the other being the Australian SKA 
Pathfinder ( ASKAP: |Johnstonet~aT1 p008| ; |Johnston| 



order to demonstrate the performance of the hardware 
on-sky. A number of science results have been reported 
from the 32 tile data (jWilliams et al.|2012||Bernardi et 



et al. 



_ ( 2007[ )). The MeerKAlQ SKA Precursor is lo- 
cated at the South African site. The MRO was chosen 
for the site of the MWA due to its extremely low levels 
of human-made radio frequency intereference, partic- 
ularly in the FM band encompassed by the MWA at 
the low end of its operating frequency range ( Bowman 



fc Rogers 20101. The MRO has been chosen as the 



host site for the low frequency component of the SKA, 
in both Phases 1 and 2, to consist of sparse aperture 
array^] 

While only three instruments have SKA Precur- 
sor status, a number of other instruments have SKA 
Pathfinder status (SKA technology demonstrator but 
not on a candidate SKA site) and are also feeding in- 
formation into the SKA design and costing process. 
The most notable of the SKA Pathfinders in the MWA 
frequency range is LOFAR, built in The Netherlands 
( |van Harlem et al.|20l"2| ). 

The MWA and ASKAP are complementary, in that 
they operate in different frequency ranges (MWA: 80 - 
300 MHz; ASKAP: 0.7 - 1.8 GHz) and employ different 
antenna technologies (MWA: aperture arrays (tiles); 
ASKAP: dishes plus Phased Array Feeds). The com- 
bined MWA and ASKAP technology specifications al- 
most fully sample the roadmap technologies for the 
SKA ( Dewdney et al.||2010 l at a single radio quiet lo- 
cation, the MRO. In particular, the MWA explores the 
so-called large-N and small-D array concept that will 
be utilised for the SKA, with large numbers of small 
receiving elements providing a large field of view on 
the sky and therefore high sensitivity over wide fields, 
equating to hig h survey speed, a key metric for SKA 
science ( Carilli fc Rawlings|2004[ ). 

All three of the MWA, ASKAP and MeerKAT are 
planning, or have operated, demonstrator instruments. 
ASKAP is building the six antenna Boolardy Engineer- 
ing Test Array (BETA0. MeerKAT is being preceeded 
by KAT"^] a seven antenna array. For the MWA, a 32 
tile test array operated between 2009 and 2011, allow- 
ing the assesment of a number of generations of pro- 
totype hardware as well as several iterations of MWA 
system integration. The MWA 32 tile array also un- 
dertook science-quality astronomical observations, in 



^ttpV/w ww, mwatelescope.org; 

|http: //www. facebook.com/Murchison. Wid efield. Array 
^http://public.ska.ac.za/meerkat 

3 http: / / www.skatelescope.org/news / dual-site-agreed- 
square-kilometre-array-telescope/ 

4 http: / /www. atnf.csiro.au/projects/askap 
5 http: / /public. ska. ac.za/kat-7 



al.|2012||McKinley et al.|2012||Bell et al.|2012||Oberoi 



et al.|20lT I . Operation of the 32 tile test array ceased 
in late 2011, in preparation for the commencement of 
construction for the final MWA instrument in early 
2012, due for completion in late 2012. 



Previously, |Lonsdale et al. (2009) described the 
conceptual underpinings of the MWA design, the ad- 
vantages of a large-N, small-D architecture for radio 
interferometers and some of the challenges inherent in 
the data processing for this type of telescope. |Lons-| 
dale et aT| ( |2009[ ) also provided brief descriptions of the 
initial plans for MWA hardware and data processing 
elements, as well as the science goals for the MWA. 

Since the |Lonsdale et al. ( 2009 1 paper was pub- 
lished, a number of design and construction consider- 
ations, that were uncertain at the time of publication, 
have been finalised. In particular the originally envis- 
aged 512 tiles was re-scoped to 128 tiles due to funding 
constraints. The construction of the final MWA in- 
strument is underway and practical completion of the 
facility is expected in late 2012. MWA commissioning 
will commence in mid-2012, with science operations 
to commence in approximately mid-2013. Thus, the 
purpose of this paper is to provide a full description 
of the MWA in its as-built form, including the final 
system architecture and sub-systems, as well as signal 
processing and data handling strategies (Section 2). 
This paper will also give a brief summary of the MWA 
science goals, a full description of which will appear 
elsewhere ( Bowman et al.|2012 1 and details on the ex- 
pected performance of the MWA (Sections 3 and 4). 
This paper is intended to inform future users of the 
capabilities of the MWA, ahead of the science opera- 
tions phase, such that users can commence planning 
for MWA science activities. Section 5 briefly discusses 
the MWA within the context of other existing and fu- 
ture instrumentation, including the Phase 1 SKA. 

2 MWA system design and sub- 
system descriptions 

We start with a very brief overview of the MWA sig- 
nal path, and provide details on each of the iden- 
tified sub-systems in subsequent Sections. Table [l] 
provides a summary of the MWA system parameters 
and expected performance. Figure [T] gives a high-level 
schematic overview of the MWA physical system and 
signal path. 

The MWA signal path starts with a dual-polarisation 
dipole antenna, roughly a square meter of collecting 
area at ~150 MHz. Sixteen of these antennas are con- 
figured as an aperture array on a regular 4x4 grid (with 
a spacing of 1.1 m). Their signals are combined in 
an analog beamformer, using a set of switchable delay 
lines to provide coarse pointing capability. Each beam- 
former produces two wideband analog outputs repre- 
senting orthogonal X and Y linear polarisations. This 
we refer to as an antenna tile and analog beamformer 
(Section 2.3). 



www.pu blish . csiro. au/jo urnals /pasa 



3 




Receiver 



Secondary 
channelisation 







Cross 
multiply 






Image and 
calibrate 






Data archive 



The array consists of 
16 groups of eight 
tiles = 128 tiles. 



The array utilises 16 receivers to sample, 
digitise and channelise the RF signals. 



The array utilises four 
FPGA-based boards 
for fine channelisation. 



The array utilises a portion of a 48 
GPU cluster to complete 
correlation of the data. 



The array utilises a portion of a 48 
GPU cluster to image and 
calibrate in real-lime. 



Final datasets (visibilities and 
images) are accumulated in a 
large data archive. 



Figure 1: High level schematic overview of MWA physical system and signal path 



The sum of our four science drivers (Section 4 and 
|Bowman et al.| ( |2012[ )) leads to a desire for a uv base- 
line distribution which has a dense core surrounded by 
a smooth r~ 2 radial distribution (Section 2.2). Our 
core area has 50 antenna tiles uniformly distributed 
over a 100 metre diameter core, surrounded by 62 tiles 
which are distributed over a 1.5 km diameter circle. 
The final 16 tiles have been placed even further out 
on a 3 km diameter circle to optimise solar imaging 
performance, and for the highest angular resolution 
imaging. 

A host of practical considerations led us to combine 
the signals from 8 tiles into a single receiver (Section 
2.4); we thus deploy 16 receivers distributed over our 
landscape such that no tile is more than 500 metres 
removed from its associated receiver. A receiver filters 
the two analog signals from each tile to a bandpass 
of 80 to 300 MHz, Nyquist samples the signals with 
an 8-bit A/D converter, and digitally filters the result 
into 24 x 1.28 MHz frequency channels which form a se- 
lectable, usually but not necessarily contiguous, 30.72 
MHz sample space. The receivers themselves are a 
mixture of high technology and low, combining high- 
speed, and hence high power, digital circuitry with me- 
chanical cooling. They are powered from a standard 
240 V mains circuit and send out their digital data 
streams on three 2.1 Gbps fiber optic links. One of 
our early design decisions was to provide spare power 
and fibre connections to most receiver locations so that 
future instrument development could share our exist- 
ing infrastructure at low incremental cost. 

About 5 km from the core of our array sits a build- 



ing provided by CSIRO, which we share with the ASKAP 
project (the Central Processing Facility: CPF). It has 
power, Electrommagnetic Interference (EMI) shield- 
ing, and water-cooled equipment racks for our data 
processing hardware. The data streams from all 16 
receivers meet here and each of the 1.28 MHz chan- 
nels is filtered by dedicated hardware into 128 x 10 kHz 
fine channels (Section 2.5). A correlator implemented 
in software using general purpose graphical processing 
units (GPGPUs) processes, averages in time and fre- 
quency space, and outputs its results in 768x40 kHz 
channels with 0.5 s resolution (Section 2.5). This 2.25 
Gbps stream of correlation products is then processed 
by the MWA Real Time System (RTS: |Mitchell et"aX 
( |2012[ )) to produce real-time calibrated images every 8 
s (Section 2.6). We have enabled the ability for visi- 
bility data to also be saved, to allow for the possibility 
of post-observation processing (Sections 2.6 and 2.7). 

The MWA runs a monitor and control system to 
schedule observations and monitor system health and 
parameters of use for data processing (Section 2.8). 

The RTS output and the uv data are transmitted 
on a dedicated 10 Gbps optical fibre connection to the 
Pawsey High Performance Computing Centre for SKA 
science in Perth, where 15 PB of data storage capacity 
has been reserved over a 5 year period to accommodate 
the MWA data archive (Section 2.7). 

Supporting the MWA instrument is the underlying 
infrastructure, including the reticulation of fibre and 
power around the array and the connection to MRO 
site-wide services provided by the Commonwealth Sci- 
entific and Industrial Research Organisation (CSIRO) 
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Table 1: System parameters for MWA 



Parameter 


Symbol 


150 MHz 


200 MHz 


Number of tiles 


N 


128 


128 


Area of one tile at zenith (m 2 ) 
Total collecting area (m 2 ) 


Acs 


21.5 


19.8 




2752 


2534 


Receiver temperature (K) 


T 

x rev 


50 


25 


"Typical sky temperature (K) 


T s ky 


350 


170 


& Field of view (deg 2 ) 


rip 


610 


375 


Instantaneous bandwidth (MHz) 


B 


30.72 


30.72 


Spectral resolution (MHz) 




0.04 


0.04 


Temporal Resolution 




0.5 s uncalibrated 
8 s calibrated 


0.5 s uncalibratc 
8 s calibrated 


Polarization 




Full Stokes 


Full Stokes 


Minimum baseline (m) 




7.7 


7.7 


Maximum baseline (m) 




2864 


2864 


Angular resolution (1.5 km array) 




-3' 


-2' 


Angular resolution (3 km array) 




-2' 





°|Nijboer, Pandey-Pommier fc de Bruyn (2009[) 



Based on FWHM of primary beam. Imageable area is significantly larger. 



(Section 2.1). 

In the following Sections we provide further detail 
on the MWA sub-systems. 

2.1 MWA infrastructure at the MRO 

The MWA support infrastructure at the MRO includes 
all of the installations and equipment required to trans- 
port power and data to, from, and around the ar- 
ray. The focus of the MWA infrastructure is a power 
and data distribution "hub" located near the core of 
the array. This Section describes the distribution hub 
and then, in turn, its connections to central MRO 
site services; and its connections to MWA equipment 
in the field. All of the infrastructure and equipment 
described in this paper conforms to the specification 
"RFI Standards for Equipment to be Deployed on the 
MRO'fl 

The hub, located approximately 200 m south of 
the MWA core, is the central distribution point for 
the power and data services into, from and around the 
array (Figure it consists of power and data distri- 
bution apparatus mounted on separate but adjacent 
concrete plinths. 

A compact substation consisting of a transformer 
and a Low Voltage (LV) switchboard housed in an en- 
vironmental enclosure (kiosk) is mounted on one con- 
crete plinth. All cable entries are from underneath 
through apertures in the precast concrete plinth. The 
transformer is a three phase ONAN type (0=mineral 
oil or synthetic insulation fluid with a fire point 300°; 
N=natural convection flow through cooling equipment 
and in windings; A=air is the external cooling medium; 
N=natural convection of the external cooling medium) 
with a ratio of 6.6kV/415V, a Dynll winding arrange- 
ment and an impedance of 4%. The incoming cable 



ASKAP-MRO-0001- Version!. 1, dated 15 Oct 2010 



enters the termination enclosure via an all-metal cable 
gland which is bonded to the cable sheath. The HV 
termination enclosure is sealed with conductive RFI 
gaskets. The LV switchboard comprises the main in- 
coming terminal, including a three pole manual changeover 
switch (mains/off/generator) and the outgoing mains 
feeders. The incoming and outgoing feeders are pro- 
tected by fused switches. No electronic equipment is 
employed within the compact substation. 

A high density fibre optic patch panel housed in an 
environmental enclosure is mounted on a separate but 
adjacent plinth. All fibre entries are from underneath 
through apertures in the precast concrete plinth. 

The MWA distribution hub is connected to the 
wider MRO power and data networks by a single in- 
coming services trench. The incoming high voltage 
cable is a 35 mm three core armoured cable with alu- 
minium conductor and an operating voltage range of 
6.35/llkV, designed and constructed to comply with 
AS/NZS1429. 1-2006. The incoming data cables are 
Prysmian Fusion link dry ribbon cables consisting of 
18 ribbons of 12 fibres (216 single mode fibres) op- 
erating at 1310 nm. There are two incoming cables 
providing a total of 432 incoming fibres. An extruded 
nylon sheath provides environmental protection. 

Distribution from the MWA hub is by cables direct 
buried in service trenches that terminate at service pil- 
lars designed to provide direct plug-in points for MWA 
receivers (and other hardware that can make use of 
the same service formats). The LV cabling has a cop- 
per conductor of various diameters based on the load 
and length of individual cable runs packaged in flex- 
ible cross-linked polyethylene insulation and with an 
extruded nylon protective barrier. The optical fibre 
cables consist of 12 cores of standard single mode fi- 
bre in a cable designed for direct burial and with an 
extruded nylon barrier. The capacity of the fibre and 
power deployed is designed to accommodate possible 
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Figure 2: Plan of MWA infrastructure, as built at the MRO. The hub referred to in the text is located at 
(0,-200), with seven radial trench lines shown in red. Receiver locations are marked as red crossess and 
tile positions are marked as blue squares. 



expansion of the core of the array at some future point 
in time. 

The service pillars are equipped for single phase 
distribution and include a single phase distribution 
board used to supply either one or two receivers. The 
distribution board also provides a local isolation point 
for the receivers. The service pillars are mounted on 
concrete plinths with bottom cable entry facilitated 
by apertures in the precast concrete. The final con- 
nection to receiver is by means of a standard three-pin 
plug and socket. 

The CPF houses the MWA post-receiver signal pro- 
cessing equipment within 16 Schroff LHX20 water cooled 
19" cabinets (42U height x800 mm widthxl200 mm 
depth). 



( Hazelton et al.| 2012). 

In rescoping the array to 128 tiles, we maximised 
science capacity by keeping the key figures of the orig- 
inal layout: excellent snapshot uv coverage, a concen- 
trated core of tiles for Epoch of Reionisation (EoR) 
power spectrum measurements, and longer baselines 
for solar observations. This has lead us to place 25% 
of the tiles within a dense 100 m diameter core, with 
a very smooth tile distribution out to 1.5 km diame- 
ter and 16 tiles in an outer region of 3 km diameter. 
The resulting tile distribution is shown in Figure[3]and 
the snapshot single frequency uv coverage is shown in 
Figure [4] The coordinates of the centre of the array 
are: Latitude -26° 42' 11.94986"; Longitude 116° 40' 
14.93485"; Elevation 377.827 m. 



2.2 Array configuration 

The initially envisaged MWA design consisted of 512 
tiles distributed with a r~ 2 density profile for radii 
of 50—750 m, with a flat distribution of tiles inside of 
50 m and 1 6 outlying tiles at ~1500 m radius ( Lonsdale 
et al. 2009). This profile provided smooth uv coverage 



with a strong concentration of short baselines at the 
scales relevant for EoR power spectrum measurements 
(Beardsley et al.]|2012[), the excellent snapshot imag- 



ing needed for transients and holographic calibration 



Even in the remote Australian desert, there are 
areas of rock outcroppings, emergency runways, flood 
zones, and heritage areas where tiles cannot be placed. 
|Beardsley et al.] ( |2012[ ) details a new tile placement 
algorithm that produces extremely smooth snapshot 
uv distributions in the presence of ground exclusion 
zones. Noting that over- and under-densities in the uv 
plane act like two dimensional wave packets to produce 
PSF (array beam) sidelobes, the new method uses a 
Bessel decomposition of the uv plane to create very 
smooth baseline distributions. 



6 



Publications of the Astronomical Society of Australia 




Figure 3: Left: An aerial map of the central 112 antennas of the MWA layout, indicated by white 5x5 m 
squares. The layout features a dense core of antennas within 50 m of the array center, with a very smooth 
distribution of antennas out to 750 m radius. The arrows indicate the direction to the outer 16 antennas 
for high angular resolution imaging which are in a rough ring of ^1.5 km radius. The purple regions 
indicate the electrical footprints of each of the 16 receivers, each servicing 8 antennas. Right: A zoom 
into the central ~1 km of the array configuration. The contours 



2.3 Tiles and analog beamformers 

The MWA antenna system is composed of the active 
and passive components described below. These com- 
ponents, when connected together, form a "tile" and 
analog beamformer (Figures [5] and Km. The MWA has 
deployed 128 antenna tiles and beamformers, in a con- 
figuration described in Section 2.2. 

A 5 m x 5 m mesh reflecting screen (effectively 
a plane mirror over the MWA operating frequency 
range), consisting of galvanised steel wire mesh with 
50 mm x 50 mm wire spacing, and 3.15 mm wire 
thickness, forms the ground screen for each tile. These 
ground screens rest directly on the ground, each po- 
sitioned to align within 2° of north-south/east-west, 
within 1.5° of perpendicular to the zenith, and with 
less than 5 cm deviations from planarity across each 
ground screen. The ground screen is composed of 
three rectangular sheets spot welded together suffi- 
ciently well to provide a continuous electrical path and 
is electrically connected to the metal chassis of the 
analog beamformer which, through a dedicated drain 
wire, is connected to the metal chassis of the receiver, 
ensuring a good discharge path for static electricity. 

Sixteen dual polarisation active antenna elements 
form a 4 x 4 regular grid on the ground screen. Each 



antenna element consists of two sets of orthogonally 
mounted aluminium broad-band dipole "bat-wings", 
each pair directly feeding a custom designed Low-Noise- 
Amplifier (LNA) circuit. The LNA circuit provides 
approximately 19 dB of gain at 150 MHz when termi- 
nated at 50 ohms, and includes a feed conversion from 
balanced to single-ended. The LNA circuit is pow- 
ered from a 5 VDC bias supplied by the analog beam- 
former. Antenna elements are mounted on the mesh 
with one dipole aligned north-south and the other east- 
west. While these active dipoles are broad-band by 
design, the anti-aliasing filter immediately prior to the 
digitisation stage in the receiver limits the telescope 
operating range to approximately 80—300 MHz. The 
centre-to-centre element spacing on the mesh is 1100 
mm corresponding to half wavelength separation at 
136 MHz. 

The signals from the 16 x 2 dipole antennas are 
wired to the analog beamformer using 50-ohm cable 
specified to LMR-100. All these element cables are 
made to the same length of seven metres to ensure 
that all antenna signals reach the analog beamformer 
front panel with identical delays. As mentioned above, 
these cables also carry the 5VDC bias from the beam- 
former to power the LNA circuits. Each of the 32 chan- 
nels in the analog beamformer has an independently 
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Figure 4: Left: The snapshot single frequency uv coverage for the central 112 antennas. Right: The 
snapshot single frequency uv coverage for the full array. 



controlled 32-step delay using five binary-weighted de- 
lay steps, each of which can be switched in or out. 
When any delay step is switched out, a gain-matching 
circuit stub is switched in to maintain relatively con- 
stant gain regardless of delay setting (tile gains are 
calibrated post-correlation). The delay steps are mul- 
tiples of 435 picoseconds, allowing a range of discrete 
relative delays between elements, from zero to 13.5 ns. 
The outputs from all 16 delay stages for each polar- 
isation are summed to create X- and Y-polarised tile 
beams on the sky. The analog beamformer, and hence 
the instrument, can support steering the X- and Y- 
beams for all 128 tiles in different directions, for a total 
of 256 beam directions. It should be noted that the 
beam shape changes with pointing direction (as well 
as frequency) and pointing directions below 30° eleva- 
tion are not available. Figure [7] shows the simulated 
beam response of a single MWA tile, at a frequency of 
150 MHz and pointed at zenith. 

The summed X- and Y-outputs are amplified and 
impedance converted to match the 75-ohm dual coaxial 
cable that connects the analog beamformer to the re- 
ceiver. This cable also carries encoded control signals 
to set the delays on the analog beamformer, as well 
as the 48 VDC power for the beamformer. Shorter 
cables conform to RG-6 specification, while longer ca- 
bles meet LMR-400-75 specification. Furthermore, on 
longer cable runs a "whitening" filter is inserted to 
overcome some of the frequency-dependent loss that 
would otherwise over-emphasise the low-frequency sig- 
nals. 

2.4 Receivers, digitisation and first 
stage channelisation 

An MWA receiver node unit (Figure [Sj) is responsible 
for taking the analog radio frequency (RF) signals from 
8 tiles, performing digitisation and coarse frequency 



channel selection of these signals, and then transmit- 
ting the resulting digital streams via fibre optic cable 
to the CPF. 

There are a total of 16 receiver nodes in the com- 
plete 128 tile MWA system. These receivers are phys- 
ically distributed around the array to minimise the 
length of the coaxial cables that carry the analog RF 
from the beamformers to the receivers, synchronisa- 
tion RF signals arriving at the receiver are passed to an 
Analog Signal Conditioning (ASC) board where signal- 
level adjustment, impedance matching and 80—300 MHz 
band-pass filtering takes place. The conditioned ana- 
log signals are then passed to an Analog-to-Digital and 
Filter Bank (ADFB) board. The signals are sampled 
at 8 bits per sample and 655.36 Msamples/sec by AT- 
MEL AT84AD001B ADC chips and fed to Xilinx Vir- 
tex 4 Field Programmable Gate Array (FPGA) chips. 

The FPGAs implement a 256 channel coarse polyphase 
filter bank which gives 256x1.28 MHz wide channels 
over the 327.68 MHz sampled bandwidth. Of these 
256 coarse channels, channel numbers below about 55 
and above about 235 are highly attenuated by the ASC 
filtering. 

The channelised data are transferred by a custom 
designed high-speed backplane to the Virtex 5 FPGA 
based Aggregator Formatter (AGFO) board. A user- 
defined subset of 24 of these channels (not necessarily 
contiguous) are formatted and transmitted on three fi- 
bre optic cables. Each of the three fibres contains data 
for 8 of the selected coarse channels for each of 2 polar- 
isations for the 8 tiles connected to that receiver. The 
three fibres together yield 30.72 MHz of RF bandwidth 
that is transmitted to the CPF. The data are transmit- 
ted in the form of 5+5 bit complex samples. Together, 
the 16 receiver nodes in the 128 tile system pass in 
excess of 80 Gbits/s of data to the down-stream signal 
processing systems. 

Additional fibres provide Ethernet communications 
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Figure 5: A schematic antenna tile layout. Note that element cables are not shown to length scale. 



for monitor and control functions and distribute a cen- 
tralised clock signal for the samplers, FPGA logic and 
timing signals for array synchronisation. A single- 
board computer controls the receiver node functions 
and services monitor and control (M&C) needs. Con- 
trol functions include analogue beamformer commands, 
setting and monitoring of ASC units, configuring and 
monitoring of high-speed digital boards, thermal con- 
trol and managing power start-up and shut-off in re- 
sponse to various conditions. 

The receiver electronics are fitted into a rack which 
is housed in a weather-tight, RF shielded enclosure 
with an integrated refrigeration unit. This allows the 
receiver to meet the stringent radio quiet requirements 
of the MRO and to provide environmental condition- 
ing and protection to enable the unit to survive in an 
environment where the ambient air temperature can 
range from 0° to 50°C. 



2.5 Correlation 

The real-time cross-correlation task for interferomet- 
ric arrays is a large computational challenge, histori- 
cally addressed by Application Specfic Integrated Cir- 
cuits (ASICs) and FPGAs. These technologies are well 



matched to the limited precision fixed point arithmetic 
required, but their application typically involves trade- 
offs between cost of development, power consumption 
and performance. ASICs are costly to develop and 
produce; FPGAs are cheaper to develop than ASICs, 
and both are much more power efficient than gen- 
eral purpose processors. However, as discussed by 
|Nieuwpoort fc Romein| ( |2009[ ), there has been con- 
siderable recent effort expended applying many-core 
processors to this problem. The MWA has chosen to 
leverage two technologies to perform the correlation 
task, a polyphase filtering task (PFB) performed by 
an FPGA-based solution, and a cross-multiply and ac- 
cumulate tas k (XMAC) utilising GPGPU technologies 
developed by |Clark et al7| (|2012 1 . 



The purpose of a spectral line correlator is to mea- 
sure the level of signal correlation between all antenna 
pairs at different frequencies across the observing band. 
The result is commonly called the cross power spec- 
trum and for any two antennas Vi and V2 can be 
formed in two ways. Firstly the cross correlation as 
a function of lag, r, can be formed: 



(Vi*V a )(T)= / Vi(t)V a (t - T)dL 



(1) 
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Figure 6: MWA tiles and analog beamformers deployed in the field. 




Figure 7: Simulated beam response for a single MWA tile, as described in the text. 



The cross power spectrum, S(v), is then obtained by 
application of the Fourier transform to reveal: 



Si 2 (v) 



(V 1 *V 2 )(T)e- l2 ™ T dT. (2) 



When the tasks required to form the cross power spec- 
trum are performed in this order (lag cross-correlation, 
followed by Fourier transform) the combined operation 
is considered an XF correlator. However the cross cor- 
relation analogue of the convolution theorem allows 
Equation[2]to be written as the product of the Fourier 
transform of the voltage time series from each antenna: 



Vi Me- 



rit x 



V 2 {t)e 2lTUt dt. (3) 



Implemented as Equation[3] the operation is described 
as an FX correlator. The FX correlator has a large 
computational advantage. In an XF correlator the 
cross correlation for all baselines requires 0(N 2 ) opera- 
tions for every lag, and there is a one to one correspon- 
dence between lags and output channels, F, resulting in 



0(FN 2 ) operations to generate the full set of lags. The 
Fourier transform requires a further 0(Flog 2 F) opera- 
tions, but this can be performed after averaging the lag 
spectrum and is therefore inconsequential. For the FX 
correlator we require 0(Nlog 2 F) operations per sam- 
ple for the Fourier transform of each data stream, but 
only 0(N 2 ) operations per sample for the cross mul- 
tiply (although we have F channels the sample rate 
is now lowe r by t he same factor). As discussed by 
Clark et al. (20121 there is a huge computational ad- 



vantage in implementing an FX correlator of at least a 
factor of F. However XF correlators have been histor- 
ically favoured by the astronomy community, at least 
in real-time applications, as there are disadvantages to 
the FX implementation. The predominant disadvan- 
tage is data growth: the precision of the output from 
the Fourier transform is generally larger than the in- 
put, resulting in a data rate increase and there is also 
the complexity of implementing the Fourier transform. 

The MWA implements a hybrid, distributed FX 
correlator solution that efficiently deals with the disad- 
vantages of an FX correlator (Figure[9]l . The F-stage is 
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Figure 8: Exploded view of an MWA receiver package. 



performed in two stages, first as a coarse, complex fil- 
ter in the receiver, as described in the previous Section, 
and then to finer spectral resolution by 4 dedicated 
FPGA-based polyphase filter bank (PFB) boards co- 
located with the cross-multiply system in the CPF. 
The fine channelisation system captures 48 fibres in 
total from 16 receiver nodes; each fibre carries 24 x 
1.28 MHz spectral channels from both polarisations of 
8 antenna tiles digitised to 5 bit precision. An indi- 
vidual PFB board ingests the full bandwidth from 4 
receivers (32 tiles) and performs a further factor of 128 
in channellisation resulting in 3072 x 10 kHz channels. 
The output of each PFB is therefore 3072 Nyquist sam- 
pled, 10kHz channels from 2 polarisations of 32 tiles, 
presented on serial data lines via an interface module 
known as the rear transition module (RTM). The last 
stage of the PFB is a bit selection stage that selects 
only the most significant 4 bits to represent the sam- 
ples. This effectively counters the major disadvantage 
of the FX correlator, data growth. In the MWA case, 
as 5 bit precision is input, and 4 bit precision is out- 
put, the F stage performs a slight reduction in data 
rate. 



the Xilinx propriety serial protocol (RocketIO) into 10 
GbE. The media conversion is performed by a set of 
16 dedicated dual Xeon servers, each housing a Xil- 
inx FPGA-based capture board (supplied by EDT In- 
corporated) which accepts a portion of the serial data 
from the PFB and presents it to system memory where 
a bespoke software application routes each packet to a 
target machine. A connection based protocol (TCP) is 
used due to the complex nature of the packet switching 
and the synchronisation issues arising from capturing 
many parallel streams in a general purpose computing 
environment. 

Although the purpose of the operations described 
above is to facilitate re-packetisation from RocketIO 
to 10 GbE, the 16 servers also provide a capability to 
capture the voltage samples directly to disk. The volt- 
age capture system (VCS) will record a copy of the 
voltages using a continuous ring buffer via a SAS-2 
controller in each server with enough 10,000 rpm hard 
drives to store an hour of data at minimum. Upon re- 
ceiving a trigger, the ring buffers will form new rings 
using unused memory on the drives, thus preserving 



the data from the previous buffers. The VCS servers 
The MWA cross-multiplication and accumulate (XMAC)contain enough memory to store at least 4 minutes 



is frequency multiplexed and performed independently 
on 24 IBM iDataPlex dual Xeon servers, each housing 
2 x NVIDIA Tesla M2070 Graphics Processing Units. 
Each machine is allocated 128 contiguous 10 kHz chan- 
nels from all the antennas. A Chelsio 10 GbE interface 
card and a 64 port IBM BNT 8264 switch are used to 
provide the packet switching required to aggregate the 
data from each PFB output. To permit packet switch- 
ing the output of the PFB must be converted from 



of data which can be searched through for transients 
with inherent timescales shorter than the integration 
time of the telescope using incoherent dispersion and 
to prompt the trigger on the ring buffer when a de- 
tection occurs. Alternatively, an external trigger can 
be used to save the data from the ring buffer. Room 
has been intentionally reserved within this system to 
incorporate real-time GPU processing at a later date. 
The recorded voltages can be correlated using existing 
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Figure 9: Correlation sub-system overview 



software correlation solutions, such as DiFX (Deller et 
|al.|2011[|2007l >. 

In order to obtain data from all the tiles for its fre- 
quency allocation, each of the 24 XMAC servers has 
to accept packets from all of the media converters, and 
obtain them in the correct order within a narrow time 
interval. This task is enabled by extensive use of par- 
allel programming methodologies. Despite the large 
aggregate bandwidth, the bandwidth per XMAC ma- 
chine is only 2.8 Gbps, and is well within the PCIe2.0 
bandwidth of 64 Gbps available to the 16-lane Telsla 
M2070. The GPU enabled XMAC operation is de- 
scribed in detail by |Clark et al.| ( f2012[ ) and the level of 
computation required to processes 1.28 MHz of band- 
width for 128 tiles is 335 GFLOP which is also well 
within the capability of the XMAC kernel we employ. 
The XMAC is fully performed within the GPU en- 
vironment, with an output resolution of 0.5 s, and a 
channel resolution of 10 kHz (which will be combined 
to 40 kHz to facilitate storage). The format is half the 
correlation matrix for each channel with a lightweight 
FITS ( |Wells, Greisen fc Harten||1981| header and the 
output data rate from the XMAC is 3.2 Gbps. 

2.6 Real-time imaging and calibra- 
tion 

The ever-growing data rates generated by next gen- 
eration radio arrays, in the MWA case driven by the 
wide fields of view and correlation rich architecture, 
are forcing astronomers to integrate visibilities over 
longer time intervals than are otherwise desirable. One 



approach to dealing with these problems is to make 
snapshot images and to extend data reduction into 
the image domain, where various types of direction- 
dependent corrections can be readily made. 

The MWA sub-systems outlined in previous Sec- 
tions contain novel elements, such as wide-field fixed 
dipole antennas and GPU-based software correlation, 
but describe signal chain operations that are largely 
traditional in nature. Real-time imaging and calibra- 
tion systems at the correlator output are emerging as 
a critical element of next generation wide field of view 



arrays, for example as demonstrated for LOFAR (van 
Harl em et al.|2012|) and as planned for ASKAP ( |John 
ston et al.||2008| |2007[ ). As such, we include below a 
relatively extensive discussion of the MWA approach 
to this sub-system (the Real-Time System: RTS) and 
function. Figure [To] presents a schematic overview of 
the following description. 

Synthesis imaging is centred around inverting the 
three-dimensional van Cittert-Zernike theorem, which 
describes the transformation between the desired sky 
brightness distribution and the measured visibilities 

Solutions to this problem 



< |Thompson et al.|[200T l 



for arrays like the MWA are challenging, due mainly 
to four issues that worsen with increasing field-of-view 
(FOV) size: how best to deal with the three-dimensional 
problem in a way that is computationally feasible and 
conducive to high-dynamic-range deconvolution; how 
best to deal with an ionosphere that causes time- and 
direction-dependent distortions; how best to deal with 
antennas that have primary beam and polarised feed 
configuration variations in time, frequency and direc- 
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Figure 10: Overview of MWA RTS, as described in text. 



tion, and that differ from one antenna to the next; and 
how best to deal with the large data rates and data vol- 
umes. For an approximately coplanar array like the 
MWA, an imaging approach based on snapshots can 
meet all of these challenges: one can think of snapshot 
visibilities as a slice through the three-dimensional vis- 
ibility set, for which the ionosphere and the nominal 
feed configuration matrices toward each source are con- 
stant. They are also consecutive in time and so are well 
suited to pipeline processing. We will consider each of 
the issues separately. 

For a sufficiently short snapshot observation, and 
at the expense of a non-uniform sky brightness co- 
ordinate distortion, the transformation between sky 
brightness and the visibilities of a coplanar array re- 
duces to two dimensions ( BracewelT| 



Perley| [19921 |Perley||1999| |Cornwell||2005| |Ord et~al 
2010[ ). The non-uniform coordinate distortion comes 



1984 Cornwell & 



from imaging on a plane that is parallel to the ar- 
ray plane, rather than the tangent plane at the field 
centre, and thus it will change as the field centre is 
tracked. Once these coordinate distortions have been 
removed, which requires an image re-sampling process, 
time integration can continue in the image domain af- 
ter appropriate pixel-wise weighting to maximise the 



signal-to-noise ratio. This is known as warped-snapshot 
imaging, and in the RTS the procedure is combined 
with ionospheric corrections and conversion to right as- 
cension and declinat ion coordinates (in the HEALPIX 
pixelisation scheme; Gorski et al.|2005 l. 

Averaging in time is computationally expensive when 
it is done in the image domain, and in many tradi- 
tional situations the pixel-based operations will dom- 
inate the processing, often by orders of magnitude. 
For arrays like the MWA, however, as the number 
of visibilities grows relative to the number of pixels, 
it can become competitive or even cheap compared 
to alternatives such as W-projection (Cornwell 2005). 
On the other hand, removing the non-uniform warp 
from the snapshot images will lead to a shift-variant 
point spread function (PSF), which can significantly 
effect deconvolution, as described by Perley (1999 1 . 



However, the variable primary beams and the vari- 
able atmosphere described below, which are realities 
for most low-frequency dipole arrays, can both lead to 
variable PSFs, both in position and time, and joint- 
deconvolution approaches will likely be required, re- 
gardless of the imaging strategy. 

One of the most compelling reasons to make snap- 
shot images is the ionosphere. During good ionospheric 
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conditions, the size scales of the ionosphere that are 
expected to be relevant for the MWA are large rela- 
tive to MWA baselines lengths ( |Lonsdale et al.|2 009). 
The effects of the ionosphere in such a situation re- 
duce to direction-dependent shifts in source positions, 
and direction-dependent Faraday rotation that is con- 
stant across the array. While it is possible to deal 
with the time-dependent ionospheric distortions in the 
Fourier domain, the angular variations expected for 
the MWA will require either very large gridding kernels 
or many image facets. In a warped-snapshot imaging 
approach, position distortions can be removed during 
the warped pixel re-sampling step, while ionospheric 
Faraday rotation can be taken into account during 
pixel-by-pixel polarisation conversion. In the RTS, the 
distortions are modelled by interpolating between po- 
sition measurements of many compact sources with 
known positions, at the imaging cadence (i.e., every 
8 seconds). It is unclear how well we will be able to 
measure ionospheric Faraday rotation, but an array 
of GPS receivers is being tested for this purpose, and 
we note that we only need to correct changes in iono- 
spheric effects that occur within the image averaging 
time interval (i.e., several minutes). Any information 
that becomes available later (by carefully re-processing 
the data for polarised sources, from other instruments, 
etc.) can be incorporated during post-processing. 

Primary beams that differ from visibility to visi- 
bility (due, for example, to changes in time or differ- 
ences between antennas) are not just of concern for 
low- frequency dipole arrays. They are a part of wide 
FOV imaging where high dynamic range is required. 
Making direction-dependent corrections at the sample 
level is possible if one incorporates primary beam infor- 
mation into the visibility gridding kernels, an approach 



that is being investigated by a number of groups ( My- 
ers et al.|2003|| Bhatnagar et al.|2008||Morales fe Mate- 



jek||2009[ |Smirnov||2011| |Mitchell et al.||2012| |. These 
approaches typically require larger gridding kernels, 
which can be computationally demanding. This type 
of gridding also results in the pixel-wise weighting re- 



quired for optimal snapshot integration (Ord et al. 
20101. Arrays of dipoles have an added complication. 



however, in that the Jones matrices that convert be- 
tween sky and instrument polarisations are b oth time- 
and direction-dependent ( jMitchell et al.|2012 l. These 
transformations are difficult to correct for in Fourier 
space when large FOVs are involved, and will also 
lead to large convolution kernels or will require many 
facets on the sky. The RTS approach is a good fit 
to this problem, since any direction-dependent coor- 
dinate corrections can be made in the image domain. 
When generating visibility gridding kernels, the RTS 
uses a unique primary beam model for each snapshot, 
frequency, polarisation and antenna. It also has the 
ability to update the models in real time, using gain 
measurements generated while peeling strong, com- 
pact sources. 

Finally, a few points should be made about real- 
time averaging of gridded data. The RTS will average 
images over several minutes, storing the resultant in- 
tegrated images. During each interval, the ionospheric 
and coordinate variations described above are typically 



fairly small, and the larger variations that occur over 
hours can be dealt with in post-processing. Further- 
more, since we grid for a direction that is normal to 
the plane of the array, the size of the gridding kernels 
can be kept at a minimum. This is not the case for ap- 
proaches cited above, in which most of the corrections 
occur during gridding, and so would need to occur in 
real time. The task is still extremely computationally 
demanding, and the RTS has been designed and writ- 



ten to run on high-performance GPUs (Edgar et al. 
[20T0l [Qrdet al.|2009| >. 

From the discussion above, it should be clear that 
the real-time calibration system has two main tasks: it 
needs to measure primary beam patterns, and it needs 
to measure ionospheric distortions across the field of 
view. To avoid pixelisation effects during deconvolu- 
tion, it will also subtract strong compact sources from 
th e visibilities, be fore gridding (peeling, as described 
by Nordam (20041. Each GPU will process and make 



images for a small number of ad jacent frequency chan- 
nels, as described in detail by Mitchell et al. ( 2008 1 
and |Edgar et al.| ( |2010 1 , and the baseline system for 



real-time processing at MWA is 32 consecutive 40 kHz 
channels. 

Twice per second, a complete set of visibilities ar- 
rive from the correlator, split over 24 iDataPlex com- 
pute nodes in sub-bands of 1.28 MHz (the RTS is 
implemented on the same machines as the correla- 
tor cross-multiplication, sharing the GPU resources 
between the correltor and RTS). The visibilities for 
each baseline are averaged in time and frequency over 
the longest intervals for which decorrelation from delay 
and fringe rates remains below one percent, which is 
nominally 40 kHz and either 2, 4 or 8 seconds, depend- 
ing on the baseline length. After averaging, the RTS 
performs a series of standard calibration tasks, such 
as applying cable corrections, automatic RFI detection 
(as described by |Mitchell et al.|2010| ) and flagging, and 
then the visibilities are sent to the GPUs. The data 
are now ready to be used to solve for the instrumental 
and atmospheric gains and phases, a non-linear opti- 
misation problem that we approach via peeling. For 
the MWA, much of the visibility noise comes from the 
sky itself, and the first step is to generate model visi- 
bilities from antenna primary beam models and a sky 
model, which are subtracted to generate residual visi- 
bilities. At minimum the sky model will include all of 
the strong compact sources, which will be added back 
in turn -ranked based on the amount of power they 
contribute to the visibilities - for the following calibra- 
tion steps: 

1. Rotate visibilities: The visibility phases are ro- 
tated to be centred at the estimated calibrator 
position, and the visibilities for each baseline are 
averaged across all available time and frequency 
samples (i.e., averaged to 8 seconds and 32x40 
kHz), into a temporary working visibility set. 

2. Ionospheric measurements: A position offset for 

the calibrator is modelled as a baseline- and frequency- 
dependent offset in the imaginary part each vis- 
ibility, as in iMitchell et al.l (120081), which will be 



zero-mean noise if the source is at phase centre. 
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A single pan-frequency measurement is made, to 
help isolate ionospheric phases from any uncali- 
brated instrument phases. 

3. Instrumental gain measurements: A Jones ma- 
trix for each antenna is determined toward the 
calibrator, ba sed on the least squar es approach 
discussed by Hamaker ( 2000 1 and Mitchell et 
|al.| (J2008 ) . At present a running-mean is used 
to reduce noise in the measurements, however 
an improved approach that uses a Kalman filter 
is under investigation. For the most dominant 
calibrator, the optimisation is repeated for each 
frequency channel, and polynomial fits to the 
resulting Jones matrices are used for bandpass 
calibration. 

4. Source subtraction: If the gain and ionosphere 
measurements pass a set of goodness-of-fit tests, 
they are used to peel the source from the full 
resolution visibility set, thus updating the initial 
source subtraction. Otherwise the initial source 
subtraction is repeated. 

5. If there are more calibrators in the list, loop back 
to step 1. 

The output of this loop, apart from the peeled visi- 
bilities, is a set of ionospheric offset measurements and 
a set of Jones matrix measurements for each tile, dis- 
tributed in angle across the field of view and side-lobes. 
The ionospheric measurements are used to adjust the 
pixel boundaries used in the warped pixel re-sampling 
step, and we currently use a moving least squares ap- 
proach to interpolate between the calibrators. For iso- 
planatic patch sizes of ~ 4° and image sizes of ~ 30°, 
we will need at least 50 or 60 sources in the field to de- 
scribe the phase variation of each patch. Optimally, we 
would like to oversample these variations by a factor 
of at least a few, and if needed we will make position 
measurements in the images themselves to increase the 
number of sources. A Levenberg-Marquardt approach 
is used to fit primary beam models, the form of which 
will be finalised during commissioning. We expect to 
make Jones matrix calibration measurements for at 
least a few dozen sources at the imaging cadence. 

For the MWA and other similar arrays, the process 
known as deconvolution is not really deconvolution, 
since the PSF changes with time, position, and polar- 
isation. However, with various modifications, many of 
the standard deconvolution approaches can be used to 
accurately remove PSF side-lobes, and developments 
are being made on a number of complementary fronts, 



see for example Pindor et al. ( 


20111, Bernardi et al. 


(20111, 


Williams et al. 12012), 
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2012), 


Mitchel 
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Finally, one of the biggest risks involved with real- 
time calibration and imaging is that the visibility data 
volume is too large to store. The ability to loop back to 
the raw visibilities during deconvolution is at the heart 
of traditional high-dynamic-range synthesis imaging 
and is lost in such a system. The MWA approaches 
high-dynamic-range imaging from a non-traditional an- 
gle, that of a densely filled aperture that has a high 
quality instantaneous PSF with low side-lobes. This is 



important for both deconvolution and real-time cali- 
bration, and also allows us to limit the amount of PSF 
variation from snapshot to snapshot. 

However, it is unclear how well this approach will 
compare with more traditional self-calibration approaches, 
and to ensure the best quality images, the MWA project 
will also store full sets of raw visibilities. Comparisons 
of image quality will be made using the RTS running 
in real time, using the RTS running on stored data in a 
full self-calibration and deconvolution loop, and using 
other imaging strategies available in standard software 
packages. The RTS development and evaluation will 
make the MWA an important step in the development 
of low-frequency radio astronomy in the lead-up to the 
SKA. 

2.7 Offsite data transport and the 
MWA data archive 

The output of the RTS (calibrated images) and the 
visibility output of the correlator, plus miscellaneous 
control data and calibration information, totals ap- 
proximately 4.4 Gbps at maximum data rate. These 
data are streamed to a dedicated 10 Gbps connection 
implemented on the CSIRO optical fibre network be- 
tween the MRO and Geraldton, which is seamlessly 
integrated onto an AARNet network dedicated to car- 
rying data traffic from the MRO to Perth. The termi- 
nation point of the connection in Perth is iVEC, which 
hosts the Pawsey HPC centre for SKA Science (aka the 
Pawsey Centre), a new $A80M supercomputing cen- 
tre. Up to 15 PB of data storage has been allocated 
at the Pawsey Centre, ramping up over a five year pe- 
riod from 2013, to host the MWA data archive (both 
images and visibility data). At the full data rate, this 
storage allowance corresponds to approximately 300 
x 24 hrs of observation. In practice, some percent- 
age of the MWA observations will be at a significantly 
lower data rate, thus corresponding to more than 300 
days of observations. Since the visibility data will be 
archived, it will be possible to reprocess visibilities in a 
post-observation mode, using Pawsey Centre or other 
resources (organised by users) and the RTS or other 
software packages. This will allow gradual refinement 
of imaging and calibration techniques and the highest 
quality data products. 

The Pawsey Centre is currently under construc- 
tion. However, the MWA data archive has been spec- 
ified and a prototype archive system has been imple- 
mented for testing and to support commissioning and 
early operations. The MWA data archive will utilise 
the NGAS software ( |Wicenec fc Knudstrup|2007[ ) and 
is implemented on a single server machine. The server 
includes a storage array consisting of 24 x 2 TB drives 
arranged in a RAID5 configuration for redundancy. 
The total amount of storage is ~48 TB when parity 
and striping are taken into account. The storage ca- 
pacity is expandable up to ~ 170 TB if required. There 
are 24 separate 1 Gbps links from each of the correla- 
tor/RTS nodes that are multiplexed into the storage 
array at a peak sustained data rate of ~3.2 Gbps for 
visibility data and ~1.2 Gbps for RTS data, combin- 
ing to data rate of ~4.4 Gbps while observing. This 
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equates to ~24 hours of continuous observing time at a 
32 bit real and imaginary precision, 0.5 second integra- 
tions and 40 kHz course channel configuration. Data 
throughput tests have shown that NGAS is capable of 
streaming to the RAID5 disk array at a rate of ~6.4 
Gbps. The remaining bandwidth will be dedicated to 
management links required for operations. 

The NGAS archive has been engineered to allow 
file formats to change over time or new data pipelines 
to be installed without the need to change code or 
modify the underlying archive software configuration 
in any way. A data capture application programmer 
interface has been developed to be the entry point into 
the archive that can be embedded into any applica- 
tion to accommodate future data pipelines. Engineers 
and scientists will have access to a web based inter- 
face that is the portal into the archive. For a given 
set of observation search results, users will be pre- 
sented with links to data files and their associated 
meta-data. The archive will offer the functionality 
to convert raw visibility data into a standard UV- 
FITS format. Such tools will include the capability 
to greatly reduce the bandwidth and processing over- 
heads for each user. Users will have the option to ac- 
cess and download the raw visibility data if required. 

2.8 Instrument monitor and control 

The large number of tiles and the ubiquity of embed- 
ded processing have led us implement a highly dis- 
tributed Monitor and Control (M&C) system for the 
MWA. Most interferometer M&C systems are mono- 
lithic in design with a tight command and control paradigm 
for each antenna and hardware system. In contrast, 
the MWA M&C system is a much more distributed 
design that leverages the embedded processing in each 
hardware system. In essence, each local hardware con- 
troller is responsible for the health and safety of that 
instrument system and all of the detailed hardware 
state changes (e.g. power up sequence, order of digital 
mixer changes to change the receiver frequency, etc.). 
The central portions of the M&C are then primarily 
concerned with orchestrating all of the hardware for 
observing and commissioning and providing a central 
repository for all of the configuration and monitoring 
information (meta-data). 

Part of this change is due to the ubiquity of embed- 
ded processing — even power outlets now have embed- 
ded webservers — so it is reasonable to expect every 
system that interfaces with M&C to have the local in- 
telligence to perform low-level operational tasks. The 
other driving factor is the sheer number of tiles and 
field hardware systems. As the number of antennas 
reaches into the hundreds it becomes more difficult to 
maintain centralised control. Instead of trying to have 
a single entity simultaneously control hundreds of sub- 
systems, we have opted for a model where many indi- 
vidual entities are coordinated centrally. The central 
coordinator directs the distributed entities at a high 
level and these entities are responsible for controlling 
and monitoring the given sub-systems. 

At the heart of the MWA M&C system is a rela- 
tional database that serves as a central repository of 



all system information. This database includes cur- 
rent and historical configuration; the planned observ- 
ing schedule (by GPS second), the detailed state changes 
of each hardware and software system; monitoring data; 
and links to associate data files with the schedule, 
configuration, and all associated commands and state 
changes. 

This central database allows us to accurately re- 
construct the state of the array for any observation, 
including a large volume of debug information. For 
example, we record the full broadband 0—300 MHz 
spectrum for each tile every ~8 seconds. Compar- 
ing the spectra of different tiles and cross-referencing 
with changes in pointing direction can quickly diag- 
nose many errors, even when they only happen spo- 
radically. The database is implemented in Postgres, 
and all of the other M&C systems interact directly or 
indirectly with the database. 

The other major M&C systems are: 

• The Scheduler loads the desired observing sched- 
ule into the database. As noted below, there are 
many settings which can be either set specifi- 
cally or delayed until run time (e.g. use all of 
the antennas in the list of good antennas). The 
Scheduler is implemented in a scriptable Python 
library; 

• The array configuration web pages allow the en- 
try and modification of the array configuration 
information. This includes the location, serial 
numbers, and interconnections of all the ma- 
jor hardware components and includes specific 
pages for common configuration changes (e.g. 
moving a beamformer from one tile to another); 

• Each hardware and software component has a lo- 
cal control program. It receives commands, im- 
plements those commands at the indicated clock 
tick (synchronised by the array clock and PPS), 
and records all of its state changes in the central 
database; 

• The Observation Controller serves as the con- 
ductor, and reads the schedule and the configu- 
ration tables of the database and sends the ap- 
propriate commands to the field hardware. All 
commands are sent in advance with the GPS 
time of when the command should be imple- 
mented to allow clock accurate commands de- 
spite the ~10 ms jitter inherent in any messaging 
system. The amount of advance notice is part of 
the interface definition for each hardware to Ob- 
servation Controller relationship. The Observa- 
tion controller also resolves any observation-time 
decisions. For example, this allows the schedule 
to be written weeks in advance to use only the 
tiles the instrument team judge as good, and 
which tiles are actually in that list are resolved 
at observation time. Even within an observa- 
tion, as tiles are added and removed from the 
list the tiles included in the observation are dy- 
namically adjusted. The Observation Controller 
is implemented in Java; 

• The Facility Controller serves a similar purpose 
to the Observation Controller, but concentrates 
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on startup and shutdown of the array, software 
and firmware updates, and restarting faulty equip- 
ment. While this could have been implemented 
as part of the Observation Controller, the staged 
startup of the array (e.g. making sure the neces- 
sary network switches have started prior to boot- 
ing a receiver, and staging the receiver startup 
to limit inrush current) and software updates 
are conceptually quite different than observation 
commands and we have separated the implemen- 
tation of these functions. The Facility Controller 
is implemented in Python; 

• The Monitoring Tools present the current and 
historical state of the array to users. All of 
the system information is stored in the central 
database, but these tools present the database 
information to the user in a useful way. A few 
examples include: a page that lists all of the 
data files produced during an observation and 
a summary of all the receivers and tiles that 
were online; a zoomable plot of the temperature 
of each tile vs. time (~ambient temperature) or 
each receiver vs. time (~air conditioner perfor- 
mance); a plot of the broadband 80—300 MHz 
spectra during the course of an observation; re- 
sults of a commissioning observation that turns 
on one dipole at a time for each tile to measure 
the complex gain of each dipole as a function 
of frequency. The Monitoring Tools are imple- 
mented as a diverse and growing set of web tools; 

• The Police are a set of tests that determine when 
a system is performing within specifications. They 
range from very simple (is a receiver respond- 
ing to commands) to quite complex (identify- 
ing unstable LNAs from the broadband spectra). 
The results of the Police are logged back to the 
database and are the basis of alerts presented by 
the Monitoring Tools (turning an receiver status 
from green to red) and can be used to dynam- 
ically adjust the array configuration (remove a 
tile from the good list). 

Together the components listed above act in con- 
cert to enable a very flexible and robust M&C system. 
To date the system has performed well, with the inher- 
ent flexibility and the volume of monitoring data serv- 
ing as a great resource in commissioning and debug- 
ging the MWA. Partly because of the modular nature 
of the MWA, the M&C system is inherently scalable 
to many hundreds of tiles and may provide a useful 
starting point for future arrays with large numbers of 
antennas. 



3 MWA performance metrics 

For the MWA as described in this paper, the time 
needed to reach a point source sensitivity of a s is: 



t = 



\A cS Ne c 



erf Bn D 



(4) 



where fee is the Boltzmann constant, T = T a k y + 
Tr CV is the system temperature, A e s is the effective 



area of each antenna tile, N is the number of antenna 
tiles, e c is the correlator efficiency (assumed unity for 
the MWA), B is the instantaneous bandwidth, and n p 
is the number of polarisations. For the parameters 
given in Table [l] at 150 MHz, this equation reduces to 
t « 8 x 10 4 /B<tj seconds, for a g in mjy. 

The intrinsic source confusion limit is estimated 
to be ~10 - 20 mjy at 150 MHz at the MWA angular 
resolution of ~ 1 — 5'. Table[2]lists approximate derived 
sensitivities. 



4 MWA science goals 

The MWA will be capable of a wide range of science 
investigations. These planned investigations are de- 
scribed in detail by |Bowman et ah] ( |2012[ ). Here, we 
review the four key science themes that encompass the 
planned investigations and that have driven the design 
of the array. The key science themes for the array are: 
1) detection of fluctuations in the brightness tempera- 
ture of the diffuse redshifted 21 cm line of neutral hy- 
drogen from the epoch of reionisation (EoR); 2) studies 
of Galactic and extragalactic (GEG) processes based 
on a deep, confusion-limited survey of the full sky vis- 
ible to the array; 3) time domain astrophysics through 
exploration of the variable radio sky (transients); and 
4) solar heliosphere and ionosphere (SHI) imaging and 
characterisation via propagation effects on background 
radio sources. 

Exploration of the Cosmic Dawn, the period when 
the first stars and galaxies formed in the early Uni- 
verse, has been identified as an important area for new 
discoveries within the next decade. The MWA will be 
one of the first radio interferometers to attempt to de- 
tect redshifted 21 cm line emission from neutral hydro- 
gen gas in the intergalactic medium (IGM) during this 
period. The array has been designed to optimise its 
ability to detect brightness temperature fluctuations in 
the 21 cm line emission during the EoR in the redshift 
range 6 < z < 10. During the EoR, primordial neutral 
hydrogen begins to be ionised by the radiation from 
the first luminous sources. The MWA has sufficient 
thermal sensitivity to detect the presence of the large 
ionised voids that form during reionisation through 
measurements of the power spectrum and other sta- 
tistical prop erties of the fluctuati ons to a significance 
level of 14<7 ( jBeardsley et al.|2012 1. In order to achieve 
this objective, the MWA will be a testbed to develop 
and demonstrate techniques to subtract the bright ra- 
dio foregrounds that obscure the 21 cm background. 

Radio emission from the Galaxy and from extra- 
galactic sources is both a complicating foreground for 
EoR observations and an interesting scientific target 
that forms the second key science theme for the MWA. 
The MWA will be unique in its ability to conduct an 
arc-minute resolution, confusion-limited survey of the 
full Southern Hemisphere sky below 10° declination 
over the 80—300 MHz frequency range. The survey will 
include the Galactic Centre and the Large and Small 
Magellanic Clouds. At the low observing frequencies 
of the MWA, non-thermal processes and Faraday ro- 
tation (and depolarization) effects will be prominent. 
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Table 2: Sensitivity of the MWA at 150 MHz 



Property 


B, o-s, (9b) 


Value 




Surface brightness sensitivity 


1 MHz, 1 K, (1°) 


60 


seconds 


Point source sensitivity 


1 MHz, 10 mJy 


800 


seconds 


Point source sensitivity 


31 MHz, 10 mJy 


26 seconds 




Broadband survey speed 


31 MHz, 10 mJy 


1.5xl0 5 


deg 2 /hr 


Narrowband survey speed 


0.04 MHz, 10 mJy 


190 


deg 2 /hr 



The MWA should be particularly well suited to iden- 
tifying the missing population of old and faint super- 
nova remnants (SNRs) in the Galaxy, closing the gap 
between the ~ 300 known SNRs and the expected 1000 
to 2000, and thereby providing a critical measurement 
of the total energy budget of the interstellar medium. 
Additional experiments planned for the MWA target 
radio relics and clusters, the cosmic web, and Fara- 
day tomography to probe magnetic fields. Cosmic 
ray mapping may be also be possible along sight-lines 
where sufficiently dense HII regions have become opti- 
cally thick in the MWA frequency band, blocking syn- 
chrotron emission from the Galaxy behind them. 

With its high survey efficiency, as well as planned 
long integrations on EoR target fields, the MWA will 
enable sensitive transient and variable searches for both 
rare and faint events on timescales from seconds to 
days. The MWA will perform blind searches and tar- 
get known transient sources, including low-mass stars 
and brown dwarfs, pulsars, X-ray binaries, and isolated 
neutron stars. At time resolution in the /is — Is range, 
the voltage capture capability of the MWA will allow 
studies of pulsars at low frequencies and searches for 



fast transients (e.g. Wayth et al. ( 2012 1) 



The final key science theme for the MWA encom- 
passes the field of space weather, targeting multiple 
aspects of solar bursts as they travel from the sur- 
face of the Sun to the Earth. The primary science 
focuses on high-dynamic range spectroscopic imaging 
to map the frequency, spatial, and time evolution of 
radio bursts occuring in the solar corona at heights 
of approximately 1 to 4 solar radii. Interplanetary 
scintillation will be used to constrain the density and 
turbulence of the interstellar wind in the inner helio- 
sphere. The MWA may also enable measurements of 
the magnetic field of the heliosphere plasma if it proves 
possible to track changes in the polarisation angles of 
background sources. Lastly, the calibration solutions 
of the MWA will yield near-real time corrections for 
ionospheric distortions, providing a new window into 
variability in the Earth's ionosphere. 



5 Discussion 

The MWA will be the first of the SKA Precursors to 
come to completion. The MWA will also be the only 
low frequency SKA Precursor and the most capable 
general purpose low frequency radio telescope in the 
Southern Hemisphere, located on an extremely low in- 
terference site at the MRO. The MWA is therefore a 



unique facility and highly complementary to ASKAP 
(also located at the MRO), with access to a similar field 
of view, but with ASKAP operating at higher frequen- 
cies (700 - 1800 MHz). This frequency diversity poten- 
tially allows simultaneous coverage of interesting astro- 
nomical phenomena over the frequency range 80 - 1800 
MHz from the MRO. The MWA is also highly com- 
plementary to LOFAR, as the premier low frequency 
radio telesope in the Northern Hemisphere, providing 
complementary coverage of the whole sky and also lon- 
gitudinal coverage important for observations of the 
Sun. 

As one of a range of new facilities being brought 
online around the world now and in the future, many 
with an emphasis on high sensitivity and/or wide field 
of view survey science, a comparison of relevant met- 
rics is useful. In particular, a prime metric of impor- 
tance for new survey science progra ms is the survey 
speed (SS), defined as ( |Cordes|2010) : 



SS = 



(5) 



where Qfov is the solid angle subtended by the field 
of view of the telescope in question, and r is the time 
required for an image of that field of view to reach 
a particular level of sensitivity. The wider the field 
of view of the primary array elements and the more 
primary elements in the array, the faster an array can 
survey a given region of the sky. ASKAP, the MWA 
and LOFAR are well suited to survey science, as will 
the planned SKA. 

A comparison of the survey speed metric is pro- 
vided in Figure [Tlj for various existing and future in- 
struments. 

Figure [TT] shows that the MWA is highly compet- 
itive in terms of field of view on the sky, at an or- 
der of magnitude lower sensitivity than LOFAR, but 
of comparable sensitivity to the GMRT. In produc- 
ing this comparison, the low frequency instruments are 
shown with corrections for spectral indices of —0.7 and 
—2.0, corresponding to incoherent and coherent emis- 
sion processes, respectively, in order to compare to the 
higher frequency instruments, which are all shown for 
an observing frequency of 1.4 GHz. This style of com- 
parison follows Fender & Bell (20111. Additionally, in 
Figure [TT| the aperture array instruments are assumed 
to be pointed at zenith and a common sky tempera- 
ture is assumed at low frequencies fo llowing N ijboer,| 
Pandey-Pommier fc de Bruyn| (|2009[> . The solid lines 



shown denote constant depth and constant volume fig- 
ures of merit, arbitrarily normalised to the MWA point 
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Figure 11: Comparison of field of view and sensitivity for existing and future radio telescopes. Red 
squares denote interferometric telescopes. Blue circles denote single dish telescopes. For the low frequency 
instruments, spectral index corrections to 1.4 GHz are indicated by the open diamonds and triangles, to 
allow comparison with higher frequency instruments. Note that in this figure, sensitivity increases to the 
top of the figure (o~ a decreases). Figures of merit as discussed in the text are indicated by the blue and 
green lines. 



at 200 MHz. 

The MWA is therefore very well suited to large 
scale and repeated surveys of the sky between 80 and 
300 MHz, down to the expected confusion limit of 10 
- 20 mjy. An expansion of the MWA at some future 
date to 256 tiles would move the MWA points in Figure 
[TT] higher by a factor of two in sensitivity. 

In its formal role as an SKA Precursor, the MWA 
feeds information to the international SKA project, 
primarily by informing activities such as the devel- 
opment of conceptual design reviews for the low fre- 
quency component of the SKA, and by reporting tech- 
nical and scientific results into international SKA fora. 
A significant fraction of the MWA is built upon novel 
and new approaches to radio astronomy. For example, 
the use of aperture arrays to implement steerable an- 
tennas with no moving parts is a pathfinder activity 
for the SKA and the MWA and LOFAR are pioneering 
this technology on medium to large scales. The choice 
of siting the MWA at the MRO, as part of a green- 
field development in search of the best environments 
for low frequency radio astronomy, clearly has massive 
benefits for low frequency science, but comes with sig- 
nificant challenges. The practical challenges attendant 
to the construction of highly complex systems, in loca- 



tions well away from the traditional centres of support 
for radio astronomy, are challenges that the SKA will 
have to face on an even larger scale. Lessons learned 
from the MWA have a deep relevance to how the SKA 
project could proceed. 

The MWA is expected to have an approximate five 
year lifetime, in order to acheive its science goals. Be- 
yond the operational lifetime of the facility, we note 
that the technologies that have gone into the MWA 
analog, digital and signal processing systems will be 
of order a decade old and it is likely that new, more 
efficient, more powerful, and less power intensive hard- 
ware will be available for the same task. It is possible, 
therefore, to imagine a future re- use of the MWA in- 
frastructure (power and fibre reticulation, capacity in 
CPF, and data transport to the Pawsey Centre) that 
could support a new and much more capable successor 
to the MWA, on a 5 - 10 year timescale. This sce- 
nario highlights the enormous value created in build- 
ing highly capable infrastructure at a remote and, from 
an RFI point of view, pristine site. Such a scenario 
is supported by the fact that the fielded MWA equip- 
ment in tiles, beamformers and receivers, are all highly 
portable and can be easily decommissioned and re- 
placed. Thus, the MWA consortium recognises a long 
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term future for low frequency radio astronomy at the 
MRO, through the MWA initially and then, perhaps, 
subsequent generations of instrument that re-use the 
underlying infrastructure. 

An immediate possibility that takes advantage of 
the MWA infrastructure is for the facility to host some 
of the required prototyping activities for the low fre- 
quency sparse aperture array component of the SKA. 
As the MRO is the internationally endorsed host site 
for the low frequency SKA in Phases 1 and 2, imme- 
diate advantage to the SKA project could be derived 
through use of the MWA infrastructure in testing and 
verifying the performance of prototype SKA hardware, 
through the international SKA Aperture Array Verifi- 
cation Programme (AAVP). 
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